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Description 

Method and Apparatus for Noise 
Reduction by Spectral and Subcarrier 

Averaging 

Background of Invention 
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS 

[0002] This application claims the benefit of U.S. Provisional Ap- 
plication No. 6,319,671 filed November 6, 2002. The dis- 
closure of the provisional application is incorporated 
herein by reference. 

[0003] FIELD OF INVENTION 

[0004] The present invention relates to the field of digital com- 
munications. More specifically, the present invention pro- 
vides a method and apparatus to reduce the signal- 
to-noise ratio of a communication system and a method 
for data rate optimization in a multicarrier modulation 
framework. 

[0005] BACKGROUND OF INVENTION 



[0006] Modern communication systems involve complex modula- 
tion and transmission schemes. To achieve superior per- 
formance, systems have to be robust against noise and 
distortion as they are the prime limiting factors. There- 
fore, noise reduction and compensation for channel dis- 
tortion have been of principle interest. Primarily, noise re- 
duction can provide significant performance enhancement 
in applications including, but not limited to, wired and 
wireless communications, image processing and speech 
processing. 

[0007] Removal or suppression of noise can be accomplished us- 
ing several different approaches. One of the common ap- 
proaches is data averaging. As is known in the art of data 
averaging, a signal is transmitted repeatedly over time. 
The data is received at the receiver periodically. While 
propagating through the transmission medium, the signal 
is corrupted by noise. Theoretically, the corrupting noise 
is random and its effects can be eliminated through aver- 
aging the signal over all repetitions. This corruptive ran- 
dom noise, commonly referred to as Additive White Gaus- 
sian Noise (AWGN), is well known in the art as a means of 
modeling noise in communication system analysis. In the 
presence of AWGN it is known in the art to substantially 



improve the signal quality through averaging. The averag- 
ing approach can also be helpful in the detection of infor- 
mation in extremely noisy environments. While deploying 
the noise averaging technique, a trade-off should be 
made between the number of repetitions and the amount 
of noise-reduction or signal-to-noise ratio (SNR) im- 
provement. 

[0008] | n a typical information transmission system where the in- 
formation sent out may be in the form of data, speech, or 
video, an efficient mechanism is required to segregate the 
signal and the noise. Moreover, to improve the link qual- 
ity, it is often necessary to train the receiver before actual 
data transmission begins. In such cases, usage of noise 
reduction algorithms helps further to enhance the system 
performance by converging equalizer weights, providing 
faster convergence, enabling improved channel estimation 
and improved timing extraction. 

[0009] | n a communication system known in the art, the signal is 
modulated at the transmitter through a pre-determined 
modulation scheme, and is transmitted over a medium. 
The signal may be up-converted to RF frequency using a 
high frequency carrier signal. While propagating through 
the medium, the transmitted signal is distorted and is 



subjected to interferences. The receiver receives the signal 
at an antenna or front-end. The received signal then may 
undergo some frequency down-conversion and amplifica- 
tion before it is converted back to the baseband. Then, 
the majority of signal processing and detection is accom- 
plished to extract the information. At this point, the re- 
ceiver may also use de-noising or noise-reduction algo- 
rithms to improve the signal quality or SNR. After this 
pre-detection processing is completed, the transmitted 
information is deciphered by the detection stages. 
[0010] while de-noising methods are known in the art, what is 
needed in the art is a method and apparatus addressing 
the issue of signal-to-noise ratio that provides a greater 
noise reduction of the received signal over the noise re- 
duction algorithms known in the art. 
Summary of Invention 

[0011] The longstanding but heretofore unfulfilled need for an 
improved noise reduction method for system level design 
of a modem, which enables very high bit-rate transmis- 
sion and long distance reach over the existing communi- 
cation channel is now met by a new, useful, and nonobvi- 
ous invention. 

[0012] Th e present invention addresses the issue of SNR im- 



provement by de-noising the signal. While the invention is 
not limited to only DMT (Discrete Multi-Tone) systems, 
the exemplary description and figures are for a DMT sys- 
tem typically used in a Digital Subscriber Line (DSL) 
framework. It is within the scope of the present invention 
to employ the methods described in both a single and a 
multicarrier modulation (MCM) system. 

[0013] | n accordance with one embodiment of the present inven- 
tion, noise reduction takes place prior to signal detection. 
As described in detail below, the frame averaging stage, 
or averager, exemplifies the noise reduction scheme in 
accordance with the present invention. 

[0014] The averaging stage in accordance with the present inven- 
tion can accept discrete-time signals as input or it can 
sample the incoming signal itself. The sampling frequency 
in either case is the same or greater than the Nyquist fre- 
quency. For timing reference, an external system clock 
generally supplies the clock signal. 

[0015] using the DMT framework, prior to actual data transmis- 
sion, based on channel estimation, noise power level and 
given performance requirements, optimum size of aver- 
aging can be determined. In accordance with the present 
invention, the averaging size is also referred to as the av- 



eraging interval. Once, the value of averaging interval is 
chosen, actual throughput or date rate can be easily 
found. 

[0016] | n an alternative embodiment, it is also demonstrated that 
one can follow a similar approach and average date over 
several frames in time to optimized the throughput for 
each subcarrier. 

[0017] | n a DMT transmission system as the loop length in- 
creases, high frequency attenuation is more pronounced. 
Hence, more and more subcarriers cannot be used for 
data transmission. The spectral averaging techniques in 
accordance with the present invention enable these sub- 
carriers for data transmission. More specifically, during 
the data transmission, rather than sending the same data 
frame repeatedly over time, the method in accordance 
with the present invention transmits replicas of the same 
data over different frequencies. The method of the 
present invention is beneficial in DMT transmission, as bit 
loading and unloading is accomplished in the frequency 
domain. The method in accordance with the present in- 
vention utilizes the unused subcarriers to provide replicas 
of the information at the receiver. As a result, the method 
of the present invention provides a noise reduction tech- 



nique that does not lower the date rate in order to im- 
prove the performance of the channel, nor does the 
method of the present invention use additional signal 
power to boost the performance. As such, the spectral av- 
eraging method in accordance with the present invention 
provides SNR improvement over other methods known in 
the art. 

[0018] | n an exemplary embodiment, let D be the total available 
data-carrying subcarriers, and Kbe the averaging interval, 
then each DMT frame is going to carry D /£data sym- 
bols, and each one of these symbols is sent on ic: different 
subcarriers. At the receiver, in accordance with the spec- 
tral averaging method of the present invention, distorted 
and noisy signals on these K subcarriers are averaged. The 
averaged value replaces the actual received samples on K 
subcarriers. As explained in detail below, the effective 
noise variance goes down by a factor of K. Thus, SNR at 
the detectors is improved by the method of the present 
invention. 

[0019] | n an additional embodiment of the present invention, 
multiple frames are used to improve SNR over a subcar- 
rier. In accordance with this embodiment, a noise reduc- 
tion method through subcarrier-based averaging is pro- 



vided. It is known that longer loops suppress high fre- 
quencies and that subcarriers in high frequency bands will 
be unable to carry any data. In accordance with the sub- 
carrier-based averaging embodiment of the present in- 
vention, SNRof the suppressed carriers is improved 
through timed averaging. 
[0020] | n a typical MCM system, when the channel attenuates 
high frequency subcarriers, without any noise reduction 
technique, those subcarriers are suppressed and thus are 
wasted. In accordance with the method of the present in- 
vention, it is shown that through repetition of date over 
time, some of the suppressed subcarriers can be utilized 
with reasonable attenuation for data transmission pur- 
poses. 

[0021] | n accordance with this embodiment of the present inven- 
tion, the effect of noise can be averaged out depending on 
the SNR conditions, equalization and cross-talk cancella- 
tion. Thus, effective SNR of the subcarriers can be im- 
proved. In turn, allowing a few bits to be carried on these 
subcarriers which increases the overall throughput of the 
sytstem. Effectively, the method in accordance with the 
present invention improves the overall link performance 
through subcarrier based averaging. Additionally, in ac- 



cordance with the present invention, an algorithm is pro- 
vided to estimate an independent value of an averaging 
internal over various subcarriers. 
[0022] A n objective of the present invention is to improve SNR of 
the signal. In accordance with the present invention, the 
SNR is improved by reducing the amount of noise present 
in the signal. 

[0023] An advantage of the present invention is the improved 
link quality that is established through the method of 
noise power reduction in accordance with the present in- 
vention, thereby increasing the overall system throughput. 

[0024] Another advantage of the method in accordance with the 
present invention is the reduction in noise power spectral 
density (PSD) and thus a reduction in the total noise power 
of the system. 

[0025] An additional advantage of the present invention is the 
applicability of the methods in accordance with the 
present invention to achieve noise reduction in both the 
frequency domain and the time domain within the DMT 
framework. 

[0026] Another advantage of the present invention is the maxi- 
mization of the system data rate by estimating the opti- 
mum-averaging interval individually for each subcarrier. 



Brief Description of Drawings 

[0027] For a fuller understanding of the nature and objects of the 
invention, reference should be made to the following de- 
tailed description, taken in connection with the accompa- 
nying drawings, in which: 

[0028] FIG.l is an illustrative block diagram of a two-stage SNR 
improvement scheme in accordance with the present in- 
vention; 

[0029] FIG. 2 is an illustrative example of a DMT based DSL sys- 
tem incorporating the noise reduction mechanism in ac- 
cordance with the present invention; 

[0030] FIG. 3 is an illustrative example of a DMT frame structure 
when the spectral averaging algorithm in accordance with 
the present invention is employed; 

[0031] FIG. 4 is a schematic illustration of the spectral averager 
in accordance with the present invention; 

[0032] FIG. 5 is an illustration of the noise-reduction perfor- 
mance curves for various loops in accordance with the 
present invention; 

[0033] FIG. 6 is an illustration of an attenuation or SNR curve for 
a twisted pair loop plant as in known in the art; 

[0034] FIG. 7 is a schematic illustration of a subcarrier-based av- 
erager in accordance with the present invention; 



[0035] FIG. 8 is an illustration of the distribution of averaging in- 
terval for subcarrier based averaging in accordance with 
the present invention; and 

[0036] FIG. 9 is an illustration of the equations in accordance 

with the present invention. 
Detailed Description 

[0037] As is known in the art, the concept of averaging can be 

applied to any data transmission system. Begin simple and 
economic, data averaging can help to improve the signal 
quality and therefore the overall system performance. For 
SNR improvement, the technique of noise reduction 
through averaging has been utilized in various fields like 
speech processing, imaging processing, medical imaging, 
etc. 

[0038] As is know in the art, the averaging technique uses a 

repetitive signal to average and thus eliminate the effect 
of random additive noise. Therefore, the same data signal 
or frame must be transmitted several times to accomplish 
averaging. In some cases, it can result in improved link 
quality at the cost of decreased throughput. Certainly, in- 
creased overhead is not a desirable situation in a commu- 
nication channel. 

[0039] Several techniques are known in the art for SNR improve- 



ment. One known technique is diversity. With diversity the 
receiver can obtain signal replicas through multiple an- 
tennas or through reception in multiple frequency bands. 
In modern wireless communication systems diversity is 
extensively used. Another approach to SNR improvement 
known in the art is spectral subtraction, wherein the esti- 
mated noise spectrum is subtracted from the noisy signal 
spectrum. 

[0040] The method and apparatus in accordance with the present 
invention provides SNR improvement through noise re- 
duction by means of spectral averaging and subcarrier 
based averaging techniques. While various modulation 
techniques are within the scope of the present invention, 
a multicarrier modulation system is described by the fol- 
lowing exemplary embodiments. 

[0041] | n accordance with the present invention some of the 

available subcarriers are used to carry the same data. This 
method provides an improvement in SNR in many cases. 
For example, in a DSL system, the twisted pair telephone 
line acts as a low pass filter. Therefore, as the loop length 
increase, high frequency attenuation is more severe. On 
these high frequency subcarriers, the signal is degraded 
by attenuation and additive noise. In such cases, com- 



monly transmission is avoided on certain subcarriers. 
Sometimes, the attenuation is so severe that, the signal 
level is beneath the noise level (Noise Floor). In this situa- 
tion, the SNR is negative. Therefore, the throughput or 
data rate is reduced. 

[0042] | n one embodiment of the present invention employing 

spectral averaging, averaging is performed of data carried 
by different subcarriers in the same frame. 

[0043] | n an additional embodiment of the present invention em- 
ploying subcarrier averaging, several frames are used to 
perform the averaging operation. 

[0044] a s previously described, averaging can improve perfor- 
mance by effectively reducing noise and increasing SNR. 
Moreover, it is desirable to boost the signal level on sup- 
pressed subcarriers so that they can carry some data. As 
shown with reference to Figure 1, a two-stage approach is 
suggested. A channel distortion compensation stage 10 
and a stage to alleviate the effects of random noise 15 are 
suggested. A powerful time or frequency domain equal- 
izer is suggested to mitigate the channel attenuation ef- 
fects. 

[0045] Theoretically, with extremely good equalization, the pro- 
posed scheme can indeed improve the SNR and thus in- 



crease the throughput. With reference to Figure 2, a DMT 
based DSL system with noise reduction mechanism 20 is 
shown. In the first phase of transmission, the receiver is 
trained and link initialization takes place. Based on train- 
ing, the transmitter can generate a profile of constellation 
size for a given subcarrier. During actual transmission, the 
binary signal can be mapped in PSK or QAM symbol, and 
loaded as per the bit loading profile 25. 

[0046] | n accordance with the present invention, the method of 
noise reduction utilizing spectral averaging is described. 
Consider N to be the total number of carriers, and K to be 
the averaging index or interval. In a given frame, K sub- 
carriers will carry the same symbol. As such, the actual 
number of symbols carrier per DMT frames is given by 
equation (1) of Figure 9. Assuming perfect equalization, 
the effect of random noise will be mitigated. 

[0047] Using AWGN as random noise, the noise samples are zero 
mean and uncorrelated. It is also assumed that the noise 
is stationary. The transmission of duplicated data over 
various subcarriers is quite similar to transmission of the 
repetitive signal. Therefore, using time-domain averaging 
results, effective noise variance after noise averaging is 
given by equation (2) of Figure 9. 



[0048] Moreover, as is known in the art, the SNR can then be de- 
fined with relation to the symbol energy as shown in 
equation (3) of Figure 9. 

[0049] Therefore, it can be seen that the average SNR improve- 
ment for a particular subcarrier due to noise reduction will 
be as shown in equation (4) of Figure 9. 

[0050] For the DSL system, following the standard parameters, in 
terms of integer bits, the capacity of each subcarrier 
would be as shown in equation (5) of Figure 9. 

[0051] Therefore, the number of bits carried by a DMT frame will 
be as shown in equation (6) of Figure 9. 

[0052] using DMT frame rate, throughout, R can be found as 
shown in equation (7) of Figure 9. 

[0053] The transmitter generated bit-loading profile (b . s) and 
optimum value of K, based on above calculation, during 
the link initialization phase. This information is later used 
in actual data transmission. 

[0054] The DMT frame structure with spectral averaging noise 
reduction algorithm is shown with reference to Figure 3. 
At the receiver, after front-end processing, the time do- 
main signal is transformed into frequency domain signal 
using FFT. As discussed previously, channel distortion can 
be compensated through per-tone FEQ (Frequency Do- 



main Equalizer). The equalized signal is then fed to a pre- 
detection averager. Schematic block diagram of the aver- 
ager is shown in Figure 4. The averager accumulates data 
on pre-determined N group of sub-carriers. As a re- 

K useful 3 K 

suit, every DMT frame will have total of N symbols. As 

useful 

these symbols are noise averaged, under perfect equal- 
ization conditions, the effective SNR is increased by a fac- 
tor of K. The effect of this improvement in SNR can be 
seen as an increment in the total number of bits per frame 
b and therefore, throughput R. Thus, without significant 
overhead, higher throughput can be achieved. 

[0055] The theoretical result from equation (4) suggests that as 
the value of K increases, the SNR also improves linearly. In 
reality, due to the constraint of fixed number of subcarri- 
ers, limitation on constellation size and bandwidth, be- 
yond certain range, larger K values would actually reduce 
the effective throughput. 

[0056] Simulations were performed to evaluate the performance 
of the noise reduction scheme of the present invention. 
An ADSL-DMT framework together with margin adaptive 
water-filing algorithm for efficient utilization of the spec- 
trum was used. The channel model was derived using 
LineMod package using standard loop parameters. The 



performance curve results are shown in Figure 5 for vari- 
ous loops. 

[0057] A n additional embodiment of the present invention em- 
ploys noise reduction through subcarrier based frame av- 
eraging in the time domain. With reference to Figure 2, 
one can observe that after FFT 30 the subcarriers can be 
handled independently. It is one of the desirable proper- 
ties of the MCM technique. By exploiting this property, the 
reception can be improved over individual subchannels 
appropriately. Typically for a transmission medium such 
as twisted pair, attenuation of high frequency subcarriers 
is severe as the loop length increases. Without any noise 
reduction techniques, these subcarriers are suppressed 
and thus are wasted. As the spectral averaging technique 
in accordance with the present invention proposes, an av- 
eraging approach is provided to improve SNR over the 
moderately suppressed channel. Unlike the method of 
spectral averaging, the time domain approach accom- 
plishes the SNR improvement through repetitive date over 
time. Thus, some of the suppressed subcarriers with 
manageable attenutaiton are utilized for increasing the 
data throughput. It can be seen that depending on the 
SNR conditions, we can duplicate data over several frames 



on certain subcarriers and with effective cross-talk can- 
cellation and equalization, average out the effect of noise. 

[0058] At the receiver, after the FFT, the subcarriers can be 
treated separately. Moreover, the SNR of each sub- 
channel can be improved independently. As shown in Fig- 
ure 7, for a typical twisted paid channel, given the power 
spectral density and wide band power constraint, SNR of 
each subcarrier can be obtained. These subchannels can 
be analyzed as individual QAM modulated channels. In a 
typical DMT system, based on the SNR of the channel, bit 
loading is performed using certain algorithms. Essentially, 
during bit loading or allocation, capacity of that particular 
is calculated based on its SNR condition as shown by 
equation (8) of Figure 10. 

[0059] Therefore, when the SNR is found to be extremely low 
which is common in case of severely attenuated or noisy 
sub-channels, transmission of data is entirely avoided to 
retain link quality. It can be easily seen that, if the channel 
were highly dispersive, a significant amount of subcarriers 
would be attenuated. This decreases the throughput of 
the system. Hence, if an improvement in SNR over some of 
these carriers can be attained, throughput can be in- 
creased. Under minimal cross-talk conditions and with 



powerful equalization, this noise reduction of the present 
invention can boost signal reception over suppressed 
subcarriers and thus improve system performance. 

[0060] it is assumed that attenuation effects are substantially al- 
leviated through a powerful equalizer. Additionally noise 
is modeled as AWGN. This is especially true in the case of 
long loops where crosstalk is minumal, and thermal noise 
is dominant. Furthermore, it is assumed that over the av- 
eraging interval, the channel is time-invariant. 

[0061] As previous stated, in the presence of noise and disper- 
sion, signals are corrupted and attenuated. As shown in 
Figure 2, the present invention employs a powerful equal- 
izer to mitigate the channel effects. For compensation of 
the thermal noise introduced to the signal, subcarrier 
based averaging in accordance with the present invention 
is utilized. A simple schematic diagram of the subcarrier 
based averaging technique is shown in Figure 7. 

[0062] | n accordance with the method of the present invention, 
during link initialization, system parameters are obtained 
and channel attenuation as well as thermal noise level is 
detected. Based on this information, the SNR on each sub- 
carrier of the DMT system is determined. Accordingly, 
severely attenuated and thus unused carriers are identi- 



fied. Using this information, the cost of carrying one more 
bit on each subcarrier within the constellation limits is 
identified individually. The algorithm to accomplish this 
step is detailed as follows: It can be readily said that in a 
DMT transmission system, individually, each subcarrier 
encounters identical attenuation and noise conditions over 
a finite period. Therefore, similar to spectral averaging, 
averaging can be done over the signal samples received 
on a particular subcarrier. 

[0063] As per the SNR conditions, the z'-th subcarrier has bit- 
carrying capacity as shown by equation (9) of Figure 10. 

[0064] Recall that thermal noise can be modeled as AWCN. 
Therefore, time-averaging K samples received on z'-th 
subcarrier will lower the effective noise variance by the 
same amount, as shown in equation (10) of Figure 10. 

[0065] Therefore, as shown in equation (4), effective SNR after 

averaging is improved as shown in equation (11) of Figure 
10. 

[0066] As a result, due to averaging the subchannel capacity will 
be as shown in equation (12) of Figure 10. 

[0067] it is important to note that noise reduction will be utilized 
only for suppressed channels. Therefore, the proposed 
approach maintains the throughput at least to the same 



level without noise reduction. 
[0068] Consider z'-th suppressed subchannel capacity without av- 
eraging to be b , and with noise reduction to be b . For 

"* ~ i i.avg 

the sake of simplicity, the subscript z is abandoned from 
the above quantities. To obtain the cost of carrying one 
more bit through averaging over this channel, setting Ob 
b) =1. Then it can be seen that equation (13) of Figure 10 
results. 

[0069] Therefore, equation (14) and equation (15) of Figure 11 
result. 

[0070] Essentially, this is the cost of carrying one more bit on z'- 
th carrier. It is in terms of averaging interval or number of 
samples required for averaging. Clearly, it depends upon 
SNR conditions and system parameters. Moreover, lower 
the SNR, longer the averging interval. 

[0071] Based on a predetermined maximum value of K, carriers 
that can be enabled to carry data through noise reduction 
are identified. To further improve the performance, the 
same procedure is repeated for the selected sub-carriers 
to carry one more bit. After several iterations, we have a 
good estimate of K for each of the sub-channels. 

[0072] Before a actual data transmission begins, the transmitter 
is informed by the receiving side about best values of K 



for each subchannel. The transmitter uses this informa- 
tion while bit loading. In fact, it repeats a symbol one a 
particular carrier over K frames. Figure 7 shows an exam- 
ple. Similarly, at the receiver, the bit-unloading stage ac- 
cumulates K samples on individual subchannels, and av- 
erages them over the same interval. Thus, prior to detec- 
tion SNRwill be improved. 

[0073] a typical DMT-DSL system examples is used her to 
demonstrate the technique. However, it is within the 
scope of the present invention to use the method and ap- 
paratus with any MCM technique. Considering a VDSL sys- 
tem with 6 Kft loop length, the total wideband power of 
both upstream and downstream to be 23 dBm, and maxi- 
mum K to be 512. At the end of the first iteration, i.e. av- 
eraging interval for different subcarriers was found to be 
in the range of 2 to 64. The distribution of K over subcar- 
riers is shown in Figure 8. 

[0074] | n conclusion, the effective SNR of the subcarriers can be 
improved. In turn, this allows carrying more bits of these 
subcarriers and thus increases the overall throughput of 
the system. Without noise reduction, such subcarriers 
would be unusable, but trough a reasonable amount of 
repetition, we can improve overall link performance. Sim- 



pie algorithms are proposed to estimate independent 
value of averaging interval over such subcarriers. 

[0075] it w i|| be seen that the objects set forth above, and those 
made apparent from the foregoing description, are effi- 
ciently attained and since certain changes may be made in 
the above construction without departing from the scope 
of the invention, it is intended that all matters contained 
in the foregoing description or shown in the accompany- 
ing drawings shall be interpreted as illustrative and not in 
a limiting sense. 

[0076] it is also to be understood that the following claims are 
intended to cover all of the generic and specific features 
of the invention herein described, and all statements of 
the scope of the invention which, as a matter of language, 
might be said to fall therebetween. Now that the invention 
has been described, 



